Papers with moral reasoning tasks
CharMoral: A Character Morality Dataset for Morally Dynamic Character Analysis in Long-Form Narratives (2025.coling-main)
Copied to clipboard
| Challenge: | Existing studies on character analysis focus on character identification, social network analysis, and the exploration of characters' personas or personalities. |
| Approach: | They propose a four-stage framework to automatically classify actions as moral or immoral based on context. |
| Outcome: | The proposed framework is effective in moral reasoning tasks in multiple genres. |
MFTCXplain: A Multilingual Benchmark Dataset for Evaluating the Moral Reasoning of LLMs through Multi-hop Hate Speech Explanation (2025.findings-emnlp)
Copied to clipboard
Jackson Trager, Francielle Vargas, Diego Alves, Matteo Guida, Mikel K. Ngueajio, Ameeta Agrawal, Yalda Daryani, Farzan Karimi Malekabadi, Flor Miriam Plaza-del-Arco
| Challenge: | Existing evaluation benchmarks for large language models lack annotations that justify moral classifications and focus on English constrain moral reasoning across diverse cultural settings. |
| Approach: | They propose a multilingual benchmark dataset for evaluating moral reasoning of large language models . it includes 3,000 tweets annotated with binary hate speech labels, moral categories and rationales . |
| Outcome: | The proposed dataset shows a misalignment between LLM outputs and human annotations in moral reasoning tasks. |